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ABSTRACT 


^  A  search  is  undertaken  for  an  object  thought  to  be  present  with  an 
unknown  probability,  using  a  detection  scheme  whose  efficiency  is  also 
uncertain.  After  a  certain  interval,  the  search  is  called  off,  with  the 
object  unfound;  what  are  the  posterior-to-experiment  estimates  of  presence 
and  detection  efficiency?  It  is  shown  that  those  two  unknown  quantities 
interact  in  an  interesting  manner  as  the  unsuccessful  search  goes  on. 


A  RANDOM  SEARCH  FOR  A  PROBABLE  OBJECT 
by 

William  S.  Jewell 

0 .  INTRODUCTION 

Suppose  that  an  object  with  certain  distinct  characteristics  is  thought 
to  be  present  in  a  given  region  or  among  a  large  group  of  similar  objects. 

At  time  zero,  a  search  for  this  object  begins,  using  equipment  or  procedures 
whose  detection  efficiency  is  not  known  precisely.  Then,  after  a  certain 
interval  of  time  t  ,  the  search  is  called  off,  with  the  object  unfound; 

shall  we  say  that  the  object  was  undiscovered  because  it  was  not  actually 

there  in  the  first  place,  because  the  search  time  was  inadequate,  or  because 
the  search  process  was  not  efficient  enough? 

This  type  of  problem  occurs  in  software  debugging,  where  an  observed 
error  might  be  thought  to  be  due  to  a  bug  in  a  particular  portion  of  a  pro¬ 
gram,  when  in  fact  it  is  due  to  the  operating  system,  the  hardware,  line 
fluctuations,  etc.  Another  similar  situation  occurs  in  quality  control  of 
mass-produced  parts,  where  the  testing  is  done  in  batches;  a  test  could 
reveal  that  a  defective  part  might  exist  in  the  batch,  but  in  fact  the  pro¬ 
cedure  may  not  be  precise  enough  to  reveal  just  one  defect.  Another  applica¬ 
tion,  of  great  topical  interest,  has  to  do  with  the  recent  incidents  of 

intrusion  of  territorial  waters  by  foreign  submarines. 

Because  this  problem  concerns  the  change  between  initial  and  post- 
experimental  perceptions  of  certain  parameters,  we  use  a  Bayesian  formulation, 
whose  analysis  is  straightforward,  even  under  general  assumptions  about  the 
priors.  However,  the  results  are  somewhat  counter-intuitive,  particularly 
when  considered  as  functions  of  t  ,  because  of  the  interactions  between  the 


vs 


different  sources  of  uncertainty.  This  may  account  for  some  of  the  extended 
discussion  following  the  international  incidents  just  mentioned. 


1.  BASIC  MODEL 

For  the  basic  model,  we  assume  that,  if  the  object  exists  at  time  zero 
(event  E)  in  the  given  region,  then  the  random  time  until  detection,  t  , 
is  given  by  an  exponential  law  with  parameter  $  .  This  is  consistent  with 
various  randomized  search  procedures  in  which  the  probability  that  an  exist¬ 
ing  object,  not  found  by  time  t  ,  will  be  discovered  in  the  next  dt  is 
( 4>  dt )  ,  independent  of  past  history;  it  follows  that: 

Pr{f  >  t  |  E,  <J>)  =  e" (t  >_  0)  (1) 

Note  that  4)  may  be  a  characteristic  of  the  target,  the  region  of  search, 
the  search  procedures,  the  detection  threshold  of  the  equipment-observer 
combination,  or  all  of  these.  Thus,  by  an  uncertain  search  efficiency,  we 
mean  that  the  discovery  rate  is  treated  as  a  random  quantity,  $  ,  with 
known  prior  density,  p($)  . 

Let  7T  be  the  probability  that  the  object  is  actually  present  at  time 
zero,  so  that  Pr(E}  *  1  -  ir  ;  again,  our  problematic  attitude  about  E  can 
be  reflected  by  making  ir  a  random  quantity,  with  known  prior  density.  p(ir) 
is  determined  by  collateral  measurements  of  the  object's  presence,  "inside 
information,"  expert  opinion,  external  related  events,  and  "other  signs  and 
symptoms."  It  seems  reasonable  in  most  applications  to  make  <t>  and  ir 
independent,  a  priori. 

If  the  search  is  called  off  at  epoch  t  with  the  putative  object 
unfound,  then  we  have  an  experiment  in  which  the  "data"  is  V  *  [t  >  t]  , 
and  it  follows  that  the  likelihood  is  simply: 


■  v  '/  *.■  -■  " . “  *■.■  *•** ' •*  <r *»"" ■/ 
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(t  >  0) 
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Pr{P 


y}  =  (1  -  it)  +  ire 


Then,  a  simple  application  of  Bayes’  law  will  determine  the  posterior  joint 
density  of  the  unknown  parameters,  p (tt ,  $  |  V  )  ,  with  other  quantities  of 
interest  following  from  that.  However,  our  final  result  can  be  better  inter¬ 
preted  if  we  first  consider  two  related  elementary  experiments. 


2 .  ELEMENTARY  EXPERIMENTS 

Consider  first  a  search  in  which  the  detection  efficiency  is  very  high, 
or  which  has  been  in  progress  for  a  very  long  time*  Thus,  we  know  "for  sure" 
either  that  the  object  is  present  or  not,  that  is,  the  datum  is  either  E 
or  E  ;  this  amounts  to  a  Bernoulli  experiment  with  one  trial.  Then,  under 
similar  circumstances  in  the  future,  we  would  use  a  different  prior  on  ir  , 
based  upon  the  outcome  of  this  trial.  In  other  words,  our  prior  would  change 
to  either  of: 


P<»  |  i,  .  a  -  ?>  P(”>  ;  p(,  I  E,  .  i-Elli  .  (3) 

1  -  E{tt}  E{;> 

Physically  speaking,  the  outcome  of  this  experiment  reflects  upon  our 
intelligence-gathering  procedures,  preliminary  testing,  or  other  means  of 
estimating  tt  . 

We  can  get  some  idea  of  the  shift  of  opinion  by  examining  the  posterior 
means : 

E{tt  |  E}  =  E{n}  -  l/{ tt } / [  1  -  E{ tt  }  ]  ;  E{*  |  E}  =  E{^}  +  l/{^}/E{^} 

which  shows  that  the  amount  of  shift  down  (E)  or  up  (E)  is  related  to 
the  prior  variance,  1/ { tt }  .  In  particular,  if  our  prior  opinion  can  be 


modelled  by  a  Beta  (a, 6)  density,  then  we  know  the  posterior  density  is 
closed  under  sampling,  with  p(w  (  E)  being  Beta  (a, 6+1)  ,  and  p(r  |  E) 
being  Beta  (a+1,6)  .  The  posterior  means  are  then: 

E{ir  |  E}  =  (6  F { tt >  +  l)/(6  +  1)  ;  E{*  |  E}  =  6  E{r}/(6  +  1) 

where  E{ tt  }  =  a/6  ,  and  6  =  a  +  6  represents  the  "strength"  of  prior  opinion 
(essentially  the  peakedness  of  the  mode  of  p(tt)  ),  relative  to  the  experi¬ 
mental  outcome,  in  limiting  shifting  of  the  mean. 

A  contrasting  simple  experiment  is  one  in  which  we  know  the  object  is 
present,  but  once  again  search  during  an  interval  (0,  t]  and  do  not  find 
the  object.  The  data  from  this  experiment,  V  =  {(t  >  t)PiE},  thus  modifies 
only  our  prior  opinion  about  search  efficiency,  giving  an  updated  posterior 
density: 

P(4>  |  ®t)  ■  e  <*>t  p(<j>)/f(t)  ,  (4) 

where  the  normalization 

f(t)  =  E je'^j  -  J e'H  p(*)  d*  (5) 

is  the  transform  of  p(4>)  .  Thus  this  "failed"  experiment  shifts  the  mass 
and  moments  of  p(4>)  towards  zero.  In  fact,  it  is  easy  to  show  that  the 
partial  ordering 

l  &  l  |  V*  4)  I  V*  (6) 

s  t 

holds  for  all  0  <_  s  <_  t  . 

Of  particular  interest  is  the  behavior  of  mean  posterior  efficiency, 
gotten  by  using  asymptotic  forms  for  f(t)  and  the  convenient  formula 

E4 


For  example,  if  t  is  small: 


f(t)  a  1  -  E{*}  t  +  E{^2}  t2/2  -  ...  +  ...  , 


assuming  the  indicated  moments  exist,  we  find  that: 


E(4>  |  Vt)  S  E{*}  -  V{*}  t  +  ... 


(t  -  0) 


For  large  t  ,  assume  that  p($)  has  an  analytic  expansion  at  the  origin: 


p(4>)  =  l  p.  4>-Vj! 
j=J  3 

with  possibly  the  first  few  coefficients  vanishing,  say  p  =  p  =  . . ,  p  .  =  0 

U  X  J“1 

Then  we  have 

f(t)a  Pj  t~(J+1)  +  Pj+1  t_(J+2)  +  ...  ,  (t  -  »)  (9) 


so  that  the  posterior  mean  vanishes  with  t  as 


E{<i>  1  %  (J+l)t  1  +  (Pj+1/Pj)t  2  + 


(t  -*■  °o) 


The  reason  we  assume  that  the  first  non-zero  coefficient  might  be  J  >  0 
has  to  do  with  the  moments  of  ,  which  are  of  independent  interest;  for 

example,  the  posterior  mean  of  $  1  is  the  expected  remaining  time  until 
discovery  (see  Section  3).  Assuming  E{$  is  finite,  we  find,  similar  to 


(8)  above: 


E(i_1  |  E{^}E{^"1}-  1  t-  ...  +  ...,  (t  +  0)  (11) 


and,  assuming  J  >  1 


EW"1 


~  t  _  _ i 

V~  j  y  )  j(j+d 


(t  -*■  «>) 
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For  more  detailed  information,  we  need  to  use  a  specific  prior;  a 
convenient  choice  is  the  closed-under-sampling  Gamma ( c, d  )  density,  for 
which  f(t)  =  [1  +  (t/d)]  c  ,  and  p (<f>  |  V  )  is  simply  Gamma(c,d  +  t  )  . 
Then,  for  all  t  >  0  : 


E{*  1  VJ  - 


d  +  t  1  +  (t/d) 


and,  assuming  c  >  1  : 


K}  =  =  E{*~1}  +  T^T  • 


In  words,  we  find  for  this  simple  experiment  V  that,  where  the  object  is 
known  to  be  present,  our  revised  estimate  of  the  mean  rate  of  discovery  is 
dropping  towards  zero  with  increasing  duration  of  non-discovery,  or,  equiva¬ 
lently,  that  the  mean  remaining  time  until  discovery  is  increasing  without, 
limit  with  elapsed  time,  in  the  limit  as  a  linear  function  of  t  .  Inciden¬ 
tally,  this  example,  which  holds  for  arbitrary  c  >  1  ,  shows  that  the 
assumption  of  an  analytic  expansion  about  the  origin  is  too  strong,  and  that 
J  can  be  non-integer  as  well. 


INTERPRETATION  OF  THE  COMPOUND  EXPERIMENT 


Returning  to  the  experiment  in  which  both  it  and  $  are  uncertain, 
we  use  (2)  and  the  notation  of  the  last  Section  to  find  the  joint  posterior 
density: 

P(*.  ♦  I  Vt)  =  Cl  -  k(t)  ]  pCrr  |  E)  p($)  +  k(t)  p(ir  j  E)  p(<j>  |  £>*)  ,  (15) 

which  is  seen  to  be  a  mixture  of  the  two  elementary  experiments  just  analyzed. 
The  time-dependent  mixing  coefficient: 


(16) 


k(t) 


_ E{TT}f  (t) _ _ 

1  -  E{tt  >  +  E{tt  > f  (t) 


U)f  (t) 

1  +  U)f  (t)  » 


depends  upon  p(ir)  through  the  prior  expected  odds,  w  =  E{tt}/[1—  E{tt}]  , 
and  upon  p  (<p )  through  f(t)  =  E{exp(-$t)}  .  It  is  not  difficult  to  show 
that  k(t)  is  monotone  decreasing  from  E{tt)  to  zero  as  t  goes  from  zero 
to  infinity;  note  that  the  first  component  in  (15)  never  vanishes,  nor  does 
the  second  component  ever  receive  full  weight. 

Under  the  conditions  described  in  the  last  Section,  we  find  the  limiting 
approximations : 

k(t)  X:  E{tt)  -  E{ir }  [1  -  E{ir}]  E{4}  t  +  ...  ,  (t  +  0)  (17) 


and 


k(t)  ss  p. 


+  P 


J+l 


t-(J+2>  + 


(t  -  »)  (18) 


where  we  henceforth  assume  J  ^  1  . 

Specifically,  if  p(4>)  is  Gamma(c,  d  )  ,  we  find 

k(t)  *  to / [ u)  +(1  +  (t/d))c]  . 

Figure  1  shows  k(t)  and  l-k(t)  when  E{ir}  =  0.75  (u>  *  3:1)  ,  and  p(4>) 
is  Gamma(6,50)  ,  so  that  E{$}  =  0.12  and  E{^  }  =  10.0  . 

The  effect  of  the  model-mixing  in  (15)  can  be  seen  more  clearly  by 
examining  the  posterior  marginal  densities.  First,  since 


P(tt  |  Vt)  =  [1  -  k(t)]  p(ff  |  E)  +  k(t)  p(r  |  E)  , 

we  find  that  the  posterior-to-Pt  expectation  of  the  probability  that  the 
object  was  actually  present  is: 
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E{~  j  p  }  =  ~  E{t2}  [1  ~  f(t)_] 

c  1  -  EM  [1  -  f  (t)  ] 


(19) 


It  follows  easily  that  this  estimator  decreases  monotonically  with  t  from 
its  prior  expectation,  E { tt >  ,  to  the  value  E{tt  [  E}  ,  Limiting  forms  are: 


E{ir  |  Vt)~ 


(20) 


[1  -  EM] 


Figure  2  shows  E{tt  |  V  }  for  the  Gamma-based  f(t)  used  in  Figure  1,  and 
for  EM  =  0.75  and  E { tt  |  E}  =  0.60  ,  obtained  from  p(r)  being  Beta(3,l). 

The  interesting  part  of  this  result  is  not  the  monotonicity  with  t  , 
which  is  expected,  but  is  the  fact  that  the  total  decrease  is  so  small  in 
most  cases;  in  fact,  only  the  fraction  l/{m}/E{ir}  [1  -  E{tt  }  ]  of  the  original 
estimate,  E{ir)  ,  is  lost  when  the  search  is  called  off  after  a  very  long 
time  t  .  If  pM  is  Gamma,  this  fraction  is  only  (6  +  1)  1  of  the 
original  value;  unless  we  make  the  extreme  assumption  that  p (tt )  is 
"dumbbell"-shaped,  6  must  be  larger  than  2.  The  reason  why  (19)  does  not 
vanish  in  the  limit  is  discussed  below  in  Section  5. 

Turning  now  to  the  posterior  behavior  of  $  ,  since 


p(*  I  Vt)  =  [1  -  k(t)]PM  +  k(t)  p(*  |  V*)  , 


we  have  a  posterior  mean  efficiency  of 


EU  I  Vt)  =  EM  - 


w  EM  f (t)  + 


df(t) 

dt 


[1+w  f  (t)  ] 


(21) 


From  the  expansions  of  the  last  Section,  we  find: 

E{4> }  -  E{tt- }  l/(4>}  t  +  ... 


(t  -  0) 


E{  <J>  |  Pfc} 


[E{<£ }  -  coE{^ }  Pj  t'(J+1)  +  ...  (t  -v  - 


.1  • 


C 


Thus  we  obtain  the  surprising  result  that,  for  most  reasonable  p(<$>)  , 
the  posterior  mean  E{<}>  |  V  }  approaches  the  prior  mean,  E{ }  ,  for  both 
t  small  and  large,  usually  with  a  unique  minimal  value  in  between! 

For  instance,  with  p(4>)  being  Gamma (c,  d  ),  one  can  find  that 

1  +  m[l  +  (t/d)]~(c'l'1) 
l  +  a)[l+(t/d)]C 

which  is  shown  in  Figure  3,  using  the  same  Gamma (6, 50)  used  in  Figure  1. 
The  minimal  value  of  the  posterior  mean,  which  is  down  about  8.9%  from  the 
initial  and  asymptotic  value  of  E{<f> }  =  0.12  ,  occurs  at  about  t  =  14  . 

Also  shown  on  the  same  plot  is  the  corresponding  plot  of  E{<J>  |  V  }  =  c/(d+t 
from  (13). 

The  physical  explanation  for  the  shape  of  (21)  is  that,  for  small  t  , 

we  at  first  think  that  non-detection  implies  that  the  detection  rate  should 

* 

be  reduced,  as  in  the  simpler  case  with  data  V .  However,  at  the  same 
time,  we  are  also  reducing  our  expectation  on  tt  ,  which  puts  more  weight  on 
the  hypothesis  E  ;  under  this  hypothesis,  there  is  no  information  about  ^ 
to  be  obtained  from  the  experiment!  Therefore,  as  t  gets  very  large,  the 
first  term  in  the  marginal  posterior  dominates,  and  the  posterior  mean 
returns  to  E{$}  . 


E4  |  Vt)  =  E4> 
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4.  TOTAL  DISCOVERY  RATE 

The  total  discovery  rate  may  be  defined  as  p  =  ir  <}>  ,  that  is,  (pdt) 
is  the  probability  that  the  object  is  found  in  (t,  t  +  dt)  ,  conditional 
only  on  V  .  This  concept  is  useful  in  making  marginal  decisions  about 
whether  or  not  to  continue  the  search,  given  the  relative  costs  of  continuing 
to  look  and  the  value  of  finding  the  object.  For  example,  if  search  costs 
are  c  $/unit  time,  and  the  value  of  finding  the  object  is  V$  ,  both  constant 
over  time,  then  the  strategy  which  maximizes  the  expected  net  value  is  to 
continue  the  search  as  long  as  E{p  |  P  }  >  c/V  ,  if  not  yet  found. 

From  previous  formulae  we  find  the  mean  discovery  rate  to  be  the  cross¬ 
moment  of  (15): 


E{tt}  E(»}  -  E{tt  }  fE(d>}  -  EU 
1  +  E{tt>  [l  -  f (t) ] 


.-♦hi 


The  asymptotic  values  are  obtained  in  the  same  way  as  before,  giving: 

f E{^}  E{*}  -  [E{w2}  EU2}  -  [ E{tt >  EU>]2]  t  +  ...  (t  -  0) 

E{p  |  Pt}~  <  (24) 

(E{*  !  E}  [e{$}  -  co  Pj  t"(j+1)  +  ...  j  (t  -  -) 

Both  asymptotic  value  are  expected,  but  what  is  interesting  here  is  that  the 
average  total  discovery  rate  is  not  monotonic,  but  undershoots  its  final  value! 

This  phenomenon  is  shown  in  Figure  4,  using  the  same  Beta-Gamma  parameters 
as  in  previous  examples;  this  gives  an  undershoot  of  about  2.5%  at  about 
t  =  30  .  The  cause  of  this  phenomenon  is  the  "recovery"  of  E{<f>  |  P  }  with 
t  ,  since,  if  we  knew  <t>  =  "for  sure,"  then  E{p  j  V  }  would  be 
<J>q  E { 7T  |  P  }  ,  which  we  have  already  shown  is  monotone. 


CERTAIN  VERSUS  UNCERTAIN  DISCOVERY 


Many  people  who  are  willing  to  accept  the  somewhat  counter-intuitive 
behavior  of  E(4>  |  V^}  and  E{p  |  V  }  versus  t  are  still  bothered  by  the 
non-vanishing  of  E{ it  |  D  }  ;  why  don't  we  conclude  that  the  object  was  not 
present  after  a  very  long  time  of  search?  This  is  essentially  related  to 
the  conditions  implied  by  V  and  by  V  ,  and  the  related  behavior  of  <t>  . 

If,  in  fact,  the  object  were  present  (and  we  did  not  know  it),  then  the 
probability  of  actually  observing  V  (i.e.,  not  finding  the  object),  with 
t  very  large,  would  be  vanishingly  small.  Nevertheless,  if  V  ever  occurs, 
we  must,  in  this  idealized  setup,  always  hedge  our  bets  on  this  search  (and 
on  all  similar  future  searches).  So  we  are  not  permitted  to  say  the  object 
was  for  certain  not  present  as  t  gets  very  large. 

On  the  other  hand,  if,  at  some  point  during  this  experiment,  supplementary 
information  on  E  is  obtained,  then  of  course  we  must  revise  the  current 
probabilities  depending  upon  the  credulity  of  the  new  knowledge.  In  particular 
if  at  time  t  we  now  know  for  certain  that  the  object  is  present,  then  tt 
becomes  unity  "for  sure,"  and  we  would  switch  to  p (<p  [  V  )  for  the  detection 
rate.  One  can  easily  show  that 

♦  *  ♦  I  Vt  l  |  V*  (25) 

for  all  t  ,  so  that  there  is  a  discontinuity  on  our  estimate  of  $  when 
this  new  knowledge  is  acquired. 

If  E  becomes  certain  at  t  ,  it  is  also  of  interest  to  inquire  what 
the  distribution  of  remaining  time  until  discovery  will  be,  call  it  t  * 
t  -  t  .  Now, 

Prjrfc  >  u  |  V*  ,  <J>j  *  e“*u 


fc  •  •  *  *L*  •  *  »  *  *,*'•.*  •/  •/  ***  *.*  *»*  •/.■•',*  *.***•*’ V  *’*  **’*  «  *  ’’ 


for  all 
upon  t 


I  -n7' 

t  ,  according  to  (1).  On  the  other  hand,  p(<J>  |  V^)  does  depend 
through  the  equation  before  (21),  so  we  find  the  survival  law: 


Pr|Tt  >  u  i  K 


u 


t 


f(t  +  u) 
f(t) 


(26) 


This  gives  a  new  interpretation  to  the  transform  f  as  the  tail  distribution 
function  of  Tq  =  t  . 

The  fact  that  a  transform  is  log-convex  also  gives  the  interesting 

result  that  i  ~  t  ~  t  for  all  0  <_  s  <_  t  .  Or,  in  words,  even  though 
s  c 

it  is  known  that  the  object  is  present,  the  longer  the  object  remains  unfound, 
the  longer  remaining  time,  on  the  average,  it  will  take  to  find  it  (assuming 
p (<f> )  is  not  concentrated  at  a  single  point).  A  most  discouraging  outcome! 

For  example,  if  p(<{i)  is  Gamma(c,d),  then 


Pr  ,£  > 


1  +  (t/d)  lc 

1  +  ( (t  +  u)/d) 


Of  course,  E{t^  |  Pt>  =  E{<(>  ,  as  given  in  (14). 

One  could  also  define  a  remaining  time  until  detection  in  the  more  general 
case,  where  either  E  or  E  may  obtain,  by  writing 


Pr  |Tt  >  u  |  t?t>  <p  J  *  7t  e”<*’U  +  (1  -  ir)  , 


giving,  formally: 


P'!\  •  •  I  »,|  -  t'r  I  ®t{ +  — JJ}  (tf-uU^(:-")1  +  f(t-tu)  • 


The  first  term  is  the  defect,  reflecting  the  mass  at  t 
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CONCLUDING  REMARKS 


This  model  can  be  generalized  in  several  different  ways.  For  example, 
in  certain  kinds  of  intermittent  electronic  failure  problems,  the  bug  is 
actually  "present"  or  "not  present"  for  alternating  intervals  that  depend 
upon  non-observable  externalities;  the  prior  would  require  hypothesizing 
where  in  this  cycle  the  search  begins.  Similar  models  arise  if  the  detec¬ 
tion  efficiency  varies  randomly  between  several  different  levels,  as  in 
various  communications  problems.  In  intrusion  detection,  the  target  may 
actually  be  able  to  detect  the  search  effort  and  take  evasive  action,  or 
leave  the  region;  this  requires  modelling  the  time  until  the  object  has  left, 
given  it  was  originally  present. 

In  summary,  we  have  found  that  the  original  uncertainties  about  an 
object's  presence  and  our  detection  abilities  interact  in  an  interesting  way 
as  time  elapses  with  the  object  unfound.  In  particular,  posterior  estimates 
of  these  uncertainties  may  be  non-monotonic  with  the  non-detection  interval. 
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